Skip to content

WIP: Variant Type#6853

Closed
AdamGS wants to merge 14 commits into
developfrom
adamg/variant
Closed

WIP: Variant Type#6853
AdamGS wants to merge 14 commits into
developfrom
adamg/variant

Conversation

@AdamGS

@AdamGS AdamGS commented Mar 9, 2026

Copy link
Copy Markdown
Contributor

Just stashing results here to make the work more visible:

  1. Variant DType and Array
  2. ParquetVariant encoding
  3. VariantGet expression

@AdamGS AdamGS added the changelog/feature A new feature label Mar 9, 2026
@AdamGS AdamGS force-pushed the adamg/variant branch 2 times, most recently from 6ac96fe to 5306dd9 Compare March 10, 2026 15:00
@codspeed-hq

codspeed-hq Bot commented Mar 10, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 10.2%

❌ 1 regressed benchmark
✅ 1015 untouched benchmarks
⏩ 1522 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation map_each[BufferMut<i32>, 128] 770.6 ns 858.1 ns -10.2%

Comparing adamg/variant (87008f0) with develop (1c8667c)

Open in CodSpeed

Footnotes

  1. 1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

/// [`I32`]: PType::I32
/// [`NonNullable`]: Nullability::NonNullable
#[derive(Debug, Clone, PartialEq, Eq, Hash)]
pub enum DType {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do you think we should make this #[non_exhaustive] ?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think adding a new dtype should be very rare, but it is pretty painful to do right now.

@AdamGS AdamGS force-pushed the adamg/variant branch 3 times, most recently from 83828b2 to ff30b01 Compare March 11, 2026 15:25
@AdamGS AdamGS force-pushed the adamg/variant branch 2 times, most recently from 1b79bc4 to 74e1e04 Compare March 19, 2026 16:29
AdamGS added 14 commits March 23, 2026 13:41
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS

AdamGS commented Apr 15, 2026

Copy link
Copy Markdown
Contributor Author

Impl moved away from this branch, split it into multiple things and moved it elsewhere.

@AdamGS AdamGS closed this Apr 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants